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1 Introduction 


1.1 Electronic background of spin-glass interactions 

Electrons are responsible for most of the low-temperature eleetro-magnetie phenomena in solids. 
That is why there is a vast effort to apprehend reliably the behavior of systems with many elee- 
trons in erystals. Eleetrons possess eharge and spin, and sinee their mass is small, also non- 
negligible kinetie degrees of freedom. Moreover, at low temperatures the Eermi statisties and 
the Pauli prineiple add to eomplexity of many-eleetron systems. Combination of the Coulomb 
repulsion, kinetie energy and Eermi statisties leads to a large seale of eolleetive quantum phe¬ 
nomena in whieh eleetrons are either major agents or aet indireetly as mediators. The latter is 
the ease of metallie spin glasses. 

Spin glasses are magnetie systems in whieh the interaetion between the well formed and im¬ 
mobile magnetie moments is frustrated and the forees from different sourees are in eonfliet 
with eaeh other due to a frozen struetural disorder . Henee, no eonventional long-range order 
establishes at low temperatures. Nevertheless, these systems exhibit a freezing or ordering tem¬ 
perature signaling emergenee of a new “glassy ” phase. The elassieal examples of spin glasses 
are noble metals (Au, Ag, Cu, Pt) weakly diluted with transition metal ions, mostly Ee or Mn. 
Although only the interaetion between the loeal magnetie moments of the transition metal ions 
is relevant, the metal matrix in whieh they are diluted supplies the mediating partieles, eondue- 
tion eleetrons. The seattering of the eonduetion eleetrons on magnetie impurities leads to an 
indireet Ruderman, Kittel, Kasuya and Yosida (RKKY) [[T]-Q exehange interaetion between the 
spins that strongly oseillates with distanee R, 


J(R) 




cos{2kFR + 0o) 
(kpR)^ ’ 


i? —)■ cx) . 


Here Jo and 0o are material eonstants and kp is the Eermi wave number of the host metal. 
Sinee the magnetie ions are strongly diluted in the host, the distanees between the spins are 
effeetively random leading to a random distribution of the spin exehange with no preferenee for 
a homogeneous magnetie order. Positive and negative signs of the exehange are then equally 
likely and we ean model the RKKY interaetion by a randomly fluetuating exehange J{R) = 
RJo/kpR^. Sinee the alloys are very dilute, the average distanee between the aetive spins is 
large and a mean-field approximation is well justified. In this way the first mean-field model 
of spin glasses was proposed by Edwards and Anderson Q, just a few years after the first 
experimental evidenee of spin-glass behavior was diseovered 0. 


1.2 Models of spin glasses 

The spin of the eonduetion eleetron of the noble metals serves only to mediate the interaetion 
between the loeal spin moments of the transition metal alloys. In modeling the spin-glass behav¬ 
ior we ean resort to purely immobile spins distributed regularly on a lattiee with a random spin 
exehange with no preferenee for either ferro or antiferromagnetie long-range order. If H[J, S'] 
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is a spin Hamiltonian we have to evaluate the free energy of the system in the thermodynamie 
limit. We assume that the free energy is self-averaging and the system is ergodie, hence 

— 13F{T) = lim InTrg exp {—S']} = (InTr^ exp {—S']}) j . (1) 

N^oo 

We will later analyze whether any of the fundamental assumptions of the standard statistical 
mechanics is broken in the mean-field theory of spin glasses. Although Heisenberg spins are 
physically most interesting, the glassy behavior in random frustrated spin systems becomes so 
complex that the full understanding of the new phenomena having origin in the glassy phase de¬ 
mands either further simplifications or alternative spin models to study. We will deal with three 
spin-glass models that show different scenarios of the paramagnetic to spin-glass transition. 

1.2.1 Heisenberg and Ising models 

The simplest lattice spin system consists of spins with the lowest value h/2. We set h/2 = 
I, ks = 1 to simplify the resulting formulas. Since the transition temperature is relatively 
high, the spins can be treated classically. The Hamiltonian of the Heisenberg spin model in a 
homogeneous external magnetic field h on a regular lattice is 

N 

H[J, S] = -Y1 ■ S, - h ■ S, (2) 

i<j i 

with a normalization condition S* ■ S* = 1. Although the spin rotational degrees of freedom 
influence the way the system can go from the paramagnetic to the spin-glass phase [[^|^. It 
is actually the Ising model that has been mostly studied in theories of spin glasses. Only the 
projection of the spin vector to the easy axis, determined by the external magnetic field, are 
significant in the Ising model. We use the Ising model as the generic case for the demonstration 
of properties of the mean-field solutions of spin glasses. The mean-field limit of the Ising spin 
glass is called Sherrington-Kirkpatrick (SK) model. 

1.2.2 Potts model 

The p-state Potts model is a generalization of the Ising model to p > 2 spin components. 
The original formulation of Potts 0 with Hamiltonian Hp = — J2i<j Jij^ni,nj where Ui = 
0,..., p — 1 is an admissible value of spin projections of the p-state model on the lattice site R*, 
is unsuitable for practical calculations. The Potts Hamiltonian can, however, be represented via 
interacting spins Q 

1 ^ 

Hp [J,S] = --J2 ■ Si - h ■ S,, (3) 

i,j i 

where Sj = {s},... sf“^} are Potts vector variables taking values from a set of state vectors 
{eA}A=i- Functions on vectors are in equilibrium fully defined through their scalar product 

A=1 A=1 


e“e| =pSab-^ 
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for a G — 1}. We use the Einstein summation eonvention for repeating Greek indiees 

of the vector components indieating a scalar product of the Potts veetors. Using these properties 
we ean eonstruet an explieit representation of the Potts spin veetors 

{ 0 A < a 

<^—p V P+1— 

The Potts model with a random spin exehange shows a transition to a glassy phase but the 
seenario depends on the number of spin eomponents p. 


1.2.3 p-spin model 


Potts model is not the only interesting extension of the Ising model. Another 
is the so-called p-spin model. It deseribes a system of Ising spins where the 
eonneets a eluster of p spins. The Hamiltonian of sueh a model reads ||T0| 


generalization 
spin exehange 




N 

E 


T ■ 9 - 

'-’ 1112 . ■■ Ip '-’ 11‘-’12 




( 4 ) 


The p-spin model is interesting in that we can analytically study the limit p —)■ oo for which we 
know the exaet solution being the random-energy model I1ID0- It is equivalent to the one- 
level repliea-symmetry breaking solution from the repliea triek pA| |. There were hopes that one 
eould understand better the genesis of the full mean-field solution of the Ising glass by using the 
inverse number of the eoupled spins 1/p as a small parameter starting from the random-energy 
model. We show later on that 1/p expansion does not work, sinee it does not eure negative 
entropy at zero temperature for p < oo. 


1.3 Replica trick and the Sherrington-Kirkpatrick mean-held solution 

Having the spin Hamiltonian one has to resolve the free energy by evaluating the right-hand 
side of Eq. Q. We use the regular lattice with a frustrated random nearest-neighbor interae- 
tion to simulate the magnetic properties of the diluted magnetie ions in noble metals. Since the 
average distanee between the ions is large, one assumes a long-range spin exehange in the spin- 
glass models whieh leads us naturally to a mean-field theory. The modern understanding of the 
mean-field approximation is the mathematieal limit d —)■ cxd of the model on a d-dimensional 
hypereubie lattiee. Eattiee mean-field theories with long-range interactions are also ealled mod¬ 
els on fully conneeted graphs, where eaeh node of the graph is conneeted to any other node. 
The limit to infinite dimensions or the long-range interaetion introduees a new large seale. To 
make the thermodynamic limit meaningful the dependenee of the energy on this new large seale 
must be eompensated by resealing the non-loeal spin exehange so that the energy remains lin¬ 
early proportional to volume or the number of lattice sites (spins). Since the linear eontribution 
from the spin exchange Jij is missing in the spin-glass models due to frustration that does 
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prefers ferromagnetie nor antiferromagnetie order we have to rescale it as J 
simplify the numerics one usually chooses a Gaussian random distribution 


PW) 




2J2 j 


Jij/\/N. To 


( 5 ) 


Even with the mean-field simplification one faces a hard problem of averaging the logarithm 
of the partition sum, that is to evaluate the following multiple integral 

„ Af „ iV 

i<j i=l 

The next simplification is introduced by the application of the replica trick introduced in Ref. Q. 
We create ly copies of the original spin variables and average the replicated system over the ran¬ 
dom spin exchange. Simply counting the diagrammatic contributions to the free energy where 
the spin exchange is represented by a bond, one easily finds that each closed loop contributes z/ 
times. Hence, the free energy can be represented as 


/3F 


lim 

ly^O 


- lim ((Z' 

V N^oo 


)a. - 1) 


( 7 ) 


Representation Q simplifies the averaging over randomness tremendously, in particular when 
the Gaussian distribution of the random spin exchange from Eq. Q is used. The integration 
over the spin exchange can be explicitly performed for the replicated partition sum and then, 
assuming ergodicity and the existence of the thermodynamic limit together with validity of 
linear response, one can get an explicit representation for the density of the free energy of the 
Ising spin glass with a single order parameter q = N~^ mj in the glassy phase 


/(9) = -f(l 


P J —OO 


( 8 ) 


derived by Sherrington and Kirkpatrick 0. 

At first sight, there is nothing wrong with the derivation of the Sherrington-Kirkpatrick free 
energy, hence one would not expect any unphysical behavior. Nevertheless, already the authors 
themselves found that entropy, calculated from free energy as S{T) = —dF{T)/dT leads to 
a negative value at zero temperature, S'(O) = ks ~ — 0.798/cb- And this is too bad. 

This unexpected result triggered an avalanche of attempts to resolve the enigma. It was found 
soon by Monte-Carlo simulations that the entropy of the Sherrington-Kirkpatrick model is non¬ 
negative and approaches zero when lowering the temperature [1^ 161. Analyzing the stability 
of the SK solution de Almeida and Thouless showed that it is actually unstable in the whole 
spin-glass phase. The stability condition to be satisfied by the SK solution 


A = 1 - (3'^ - tanh'^ [/3 {h + r]y/q)]Y^ >0 (9) 

is broken everywhere below the transition temperature along the de Almeida-Thouless (AT) 
line in arbitrary magnetic field pT| |. Initially it was suggested that the replica trick and aver¬ 
aging over the spin exchange prior to averaging the thermal fluctuations is responsible for the 
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instability [ 18|. The theory of Thouless, Anderson and Palmer, where thermal averaging was 
performed for a fixed configuration of the spin exchanges, did not, however, resolve the prob¬ 
lem p9| . When averaging over the random exehange is applied in their theory by assuming 
ergodieity, one ends up with the SK solution [20|. After a number of unsueeessful or only 
partially successful attempts it was Giorgio Parisi who proposed a seheme of repliea-symmetry 
breaking that would lead to a (marginally) stable and thermodynamieally eonsistent equilibrium 
state pT[-|^. Indeed, two deeades later it was rigorously proven that the Parisi eonstruction 


of the repliea symmetry breaking leads to the exaet free energy of the Sherrington-Kirkpatriek 
model [ |27|[2^ . 

There is vast literature doeumenting the way to the full mean-field solution of the spin glass 
models and we refer the reader to review artieles [[29l[^ or books [[3T|-[35l for details. Here we 


use an offbeat road to the full solution of the mean-field spin-glass models by trying to identify 
the thermodynamic origin for the failure of the SK mean-field solution [[36|-[39|. 


2 Fundamental concepts of the full mean-field theory of spin 
glasses 

We now know that the repliea triek and the way we use it is not the eause of the instability of 
the SK mean-field solution. One has to find a physieal argument or a hole in the derivation 
of the SK free energy. Although the SK solution is unstable within the whole glassy phase, 
the major problem of this simple mean-field theory is negative entropy at very low tempera¬ 
tures.This eonstitutes a severe intolerable problem. One has to find the reason for this behavior. 
In deriving the mean-field solution we assumed that the fundamental prineiples of statistieal 
meehanies are valid, the thermodynamie limit exists and different statistieal ensembles are 
equivalent. Only if this is true we can equal the entropy ealeulated from the free energy of 
the eanonieal ensemble with the entropy from the mieroeanonieal one. The entropy in the latter 
ensemble is positive from definition and hence the eanonieal and mieroeanonieal ensembles in 
the Sherrington-Kirkpatriek solution are not equivalent and do not lead to the same physieal 
results. The assumptions for the existenee of the thermodynamie limit must then be revisited. 


2.1 Ergodieity, thermodynamic limit and thermodynamic homogeneity 


The very fundamental basis on whieh statistieal meehanies is built is the ergodie hypothesis. It 
is the means by whieh the long-time development of a mieroscopic state is related to statistieal 
averaging over the allowed states in the phase spaee. The Birkhoff ergodie theorem asserts that 


for ergodie systems [40| 

{/ = lim — [ 

T^oo T L 


to+T 1 

/ {X{t))dt = — 


JSe 


f {X)dSE ^ if ) 


S 5 


holds. Here T is a maeroscopic time scale, X(t) is the elassical trajectory of a microscopic state, 
Se the a eonstant energy subspace of the phase space and Xe its volume. It means that the 
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elassieal trajeetory of the mieroseopie state eovers almost everywhere the allowed phase spaee 
eonstrained by external macroseopie eonditions. It is, however, highly nontrivial to determine 
whieh are the allowed states indeed with only homogeneous maeroseopie parameters. This is 
aetually the most diffieult task in eonstrueting the proper phase spaee in statistieal models. That 
is, to find out which points of the phase space are infinitesimally close to the trajectory of the 
many-body system extended to infinite times. Since we never solve the equation of motion of 
the statistical system, we have only static means to check the validity of ergodicity. We do it 
by testing the validity of consequences of the ergodic hypothesis and its impact on the behavior 
of the equilibrium state. The most important consequence of ergodicity of statistical systems is 
the existence of the thermodynamic limit. 

The trajectory of the many-body system covers almost the whole allowed phase space. It means 
that the space covered by such trajectory does not depend on the initial state in non-chaotic 
systems. In ergodic systems then the thermodynamic limit does not depend on the specific 
form of the volume in which the macroscopic state is confined as well as on its surrounding 
environment. The ergodic macroscopic systems can either be isolated or embedded in a thermal 
bath. The thermodynamic equilibrium, the equilibrium state in the thermodynamic limit, is the 
same with vanishing relative statistical fluctuations. The thermodynamic equilibrium can then 
be reached by limiting any partial volume of the whole to infinity. The ergodic equilibrium state 
is homogeneous in the thermodynamic limit. 

Thermodynamic homogeneity is usually expressed via Euler’s lemma [ |4T| 

« F(T, y, TV,..., ...) = F(r, «!/, «TV,..., ...) 


telling us that the thermodynamic potential, free energy F in this case, is an extensive variable 
and is a first-order homogeneous function of all its extensive variables, volume V number of 
particles N, and the model dependent other extensive variables X,. Asa consequence of Euler’s 
lemma we obtain that thermodynamic equilibrium is attained as a one-parameter scaling limit 
where we have only one independent large scale, extensive variable, be it either volume or 
number of particles, and the other extensive variables enter the thermodynamic potentials as 
volume or particle densities insensitive to fluctuations of the scaling variable. 

Although the foundations of statistical mechanics are based on ergodicity, lack of ergodicity 
is widespread in physical phenomena p2| . Typical examples of ergodicity breaking are phase 
transitions with a symmetry breaking in the underlying Hamiltonian. Broken ergodicity is some¬ 
times used as a generalization of spontaneous symmetry breaking [431. Although broken global 
symmetry is always accompanied by broken ergodicity, the converse does not hold. Ergodicity 
is broken in the mean-field spin glass models without any symmetry of the Hamiltonian being 
simultaneously broken. 

Broken ergodicity represents an obstruction in the application of fundamental thermodynamic 
laws. It hence must be recovered. When ergodicity is broken in a phase transition breaking a 
symmetry of the Hamiltonian, one introduces a symmetry breaking field into the Hamiltonian, 
being the Eegendre conjugate to the extensive variable that is not conserved in the broken sym¬ 
metry transformation in the low-temperature phase. The symmetry-breaking field allows one to 
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circumvent the critical point of the symmetry-breaking phase transition and simultaneously re¬ 
stores ergodicity. Systems with no broken symmetry of the Hamiltonian at the phase transition 
do not offer natural external symmetry-breaking fields. Other techniques must be employed to 
find the proper portion of the phase space covered by the trajectory of the microscopic state in 
the low-temperature phase and to restore ergodicity. 

2.2 Real replicas and phase-space scalings 

Thermodynamic homogeneity allows us to use scaling of the original phase space. Thermody¬ 
namic quantities remain unchanged if we arbitrarily rescale the phase space and then divide the 
resulting thermodynamic potential by the chosen scaling (geometric) factor. We can do that by 
scaling the energy E of the equilibrium state. If we use a scaling factor u, that can be an arbi¬ 
trary positive number, then the following identities hold for entropy S{E) of the microcanonical 
and free energy F(T) of the canonical ensemble with energy E and temperature T, respectively 

S{E) = ks In r{E) = — In r{Ey = — In r{uE) , (10a) 

u V 

F(T) = - ^ In [Tr ^ In [Tr , (10b) 

where we denoted by r{E) the phase-space volume of the isolated system with energy E. 

The scaling of the phase space with an integer scaling factor u can be simulated by replicating 
z/-times the extensive variables. That is, we use instead of a single phase space u replicas of 
the original space. The reason to introduce replicas of the original variables is to extend the 
space of the available states in the search for the allowed space in equilibrium. The replicas 
are independent when introduced. We use the replicated variables to study the stability of the 
original system with respect to fluctuations in the surrounding thermal bath. For this purpose 
we break the independence of the replica variables by switching on a (homogeneous) infinites¬ 
imal interaction between the replicas that we denote /i“^. We then add a small interacting part 

to the replicated Hamiltonian with dynamical extensive vari¬ 
ables Xj. The original system is then stable with respect to fluctuations in the bath, represented 
by the interaction between the replicated variables, if the linear response to perturbation /i is 
not broken. If the linear response holds then the perturbed free energy per replica relaxes, after 
switching perturbation jj, off, to the original one in the thermodynamic limit 

—f3E^{n)= - InTr^ exp \— f3AH ->■ InTrexp {—/3iF} , (11) 

^ I ^ J 

where Tr^, refers to the trace in the z/-times replicated phase space. If the linear response to 
the inter-replica interaction is broken, the thermodynamic limit of the original system is not 
uniquely defined and depends on properties of the thermal bath represented by the replicated 
variables. If there are no apparent physical fields breaking the symmetry of the Hamiltonian, 
the phase-space scaling represented by replicas of the dynamical variables introduces shadow 
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or auxiliary symmetry-breaking fields, inter-replica interactions > 0. They induce new 
order parameters in the response of the system to these fields that need not vanish in the low- 
temperature phase, when the linear response breaks down. The real replicas offer a way to 
disclose a degeneracy when the thermodynamic limit is not uniquely defined by a single exten¬ 
sive scale and densities of the other extensive variables. The inter-replica interactions are not 
measurable and hence to restore the physical situation we have to switch off these fields at the 
end. If the system is thermodynamically homogeneous we must fulfill the following identity 


lim 

j-L —>^0 


dFy{^j) 

dv 


= 0 


( 12 ) 


for arbitrary z/. This quantification of the global thermodynamic homogeneity, thermodynamic 
independence of the scaling parameter u, will lead us to the construction of a stable solution 
of mean-field spin glass models. To use equation ( [T^ in the replica approach we will need 
to analytically continue the replica-dependent free energy to arbitrary positive scaling factors 
V G M"*". Specific assumptions on the symmetry of matrix /i“^ will have to be introduced. It is 
evident from Eq. ( [TT] ) that the linear response to inter-replica interactions can be broken only if 
the replicas are mixed in the z/-times replicated free energy F,y. 


2.2.1 Replicated Sherrington-Kirkpatrick model 

We apply real replicas to test thermodynamic homogeneity of the Sherrington-Kirkpatrick model. 
We replicate the Ising Hamiltonian u times 


a=l Q=1 <ij> 


and add a small replica-mixing perturbation AH{^) = | We assume that 

ergodicity and linear response hold in the replicated phase space. The averaging over the long- 
range spin exchange leads to mixing of the replicated spins and after performing averaging over 
the random spin exchange we obtain in the limit /x —0 an extended Sherrington-Kirkpatrick 
free-energy density with the Sherrington-Kirkpatrick order parameter q and new off-diagonal 
parameters [36| 


u = 


(3.P 


E{(x“*)' + 2«“‘}-(l-rf 

a^h 


1 f dr] 

fdv J 




lnTr^exp<^+ I . (13) 


a<b 


a=l 


The new parameters in the extended phase space are the response functions conjugate to the 
inter-replica interaction ]F^ and are the inter-replica susceptibilities = {{S^S'^)T)av — Q, 
in a complete analogy to the real magnetic field to which magnetic susceptibility is a linear 
response. Since we deal with a mean-field model, the susceptibilities are local. Here (/(S'))t 
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denotes averaging over thermal fluetuations and {f{S))av over the spin exehange. The SK order 
parameter is g = {{S°‘)'^)av and h = h + r]y/q. 

Replieated spin variables introdueed new order parameters that should be determined from sta- 
tionarity of the free-energy density from Eq. ( [T3] ). There are, however, two problems with this 
free energy. First, it is not a closed expression that would give its analytic dependence on repli- 
eation index u. Seeond, representation ( [T3| ) holds only for integer numbers v. The replieated 
spins do not have a direct physical meaning and were introduced only to simulate scalings of 
the phase spaee to test thermodynamie homogeneity of the resulting free energy. Henee, one 
has to eontinue analytieally free energy ( [T3] ) to a positive real replieation index z/. A speeifie 
symmetry of the matrix of the overlap susceptibilities must be assumed to reaeh this objective. 
Sueh a symmetry was found by G. Parisi and is independent of the repliea triek and the limit of 
the number of replieas to zero. 


2.3 Hierarchical construction of mean-field free energies 

First what one notiees is that the replieated free energy, Eq. eontains too many order 
parameters, z/(z/ — l)/2. It means that the solution is degenerate. Actually, the number of 
independent parameters in the z/-times replicated phase space should not be bigger than the 
number of replieas, u. Parisi assumed the following strueture of the overlap suseeptibilities 

^aa^O, = =0. (14) 

c 

It means that eaeh row/eolumn eontains the same elements, only in a different order. This 
is a consequence of the third eondition in Eq. ( [T4| ). Henee the matrix of the overlap suscep¬ 
tibilities has just 1 / — 1 independent numbers. The values of the overlap suseeptibilities ean 
appear multiple times in eaeh row. Eet us assume that we have just K different values of the 
overlap suseeptibilities that we denote xiiX 2 ^ ■ ■ ■ iXk- Let the corresponding multiplieities be 
mi, m 2 ,..., rriK- A sum rule u — 1 = Yld=i *^hen holds. An example of sueh a matrix for 
u = 8, K = 3 and mi = is illustrated in Fig.[^ 

It is now straightforward to perform the sum over the spin configurations and find a closed 
expression for the free energy with matriees fulfilling eriteria ( fT4| ). We label the overlap 
suseeptibilities so that they form a deereasing succession xi > Xi+i- The averaging over the 
thermal fluetuations of the replieated spins in the free energy from Eq. ( [T3| ) ean now be per¬ 
formed explieitly and we obtain 


K 


fK{q, {x}; W) = -7(1 - + T - m-i)xi{‘2q + Xi) + 7X1 


1=1 


(3mK J -00 




dX 




_J —00 


2 cosh 


K 


ld\h + Xiy/xi - 


Xi+i 


1=1 


f 

—00 'x/‘2,71 

mi TTiKlmK-i 


I 


(15a) 
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Fig. 1 : Matrix of overlap susceptibilities far 0 = 8 and with three levels (hierarchies) 
of symmetry breaking K = 3 exemplifying the structure allowing for analytic continuation to 
arbitrary positive u. 


with xk+i = 0 and mo = 1. It may appear eonvenient to rewrite the free-energy density to 
another equivalent form 


ffaq] ^Xi, • • •, ^Xk, mi,, ruK) = -- 


/? A 

+ ^ 2^ miAxi 
^ 1=1 



Vp In Zk (15b) 


where we ordered the parameters so that Axi = Xi ~ Xi+i A ^Xi+i A 0. We further used a 
short-hand notation for iterative partition functions 


= 


VX,Z, 


mi 
I ^i-i 


l/m; 


with an abbreviation for a Gaussian differential VX = dA e a/^. The initial partition 
function for the Ising spin glass is Zq = cosh /3 (^h + pfaq + ^iV^Xi^ ■ Frce energy 
fx is an analytic function of multiplicities (geometric parameters) mi and hence they can now 
be arbitrary positive numbers. The equilibrium state in the replicated phase space is determined 
from the extremal point with respect to variations of the overlap susceptibilities, the order pa¬ 
rameters in the glassy phase. With the symmetry from Eq. ( [T4| ) the order parameters are the 
independent values of the overlap susceptibilities xi representation ( |15a[ ) or their differences 
Axi from ( |15b[ ) and their multiplicities mi. The equilibrium values are determined from the 
extremal point of the respective free energy functional. The type of the extremum from which 
the stable equilibrium state is determined depends, however, on the values of multiplicities mi. 
If mi > 1 then the equilibrium free energy is in minimum with respect to variations of this 
parameter. If m/ < 1 then the equilibrium free energy is maximal. The value m; = 1 is a degen¬ 
eracy point at which the free energy is independent of Axi. It appears that the stable solution is 
generated by multiplicities being all between zero and one. The free energy of the spin glass is 
hence maximal in the replicated phase space. 
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Each independent value of the overlap suseeptibility, xi^ determines a repliea hierarehy. Here 
K is the number of replica hierarchies. The number of repliea hierarehies is also related to 
the level of the repliea-symmetry breaking (RSB). The eoneept of repliea-symmetry breaking 
eomes from the repliea triek used to average free energy via the replieated partition funetion, 
Eq. 0, where the order parameters in the replicated space are q + xi- The number of the order 
parameters is 2K +1. If all Xi = 0 and K = 0 we have a single order parameter q and the 
solution is ealled replica-symmetrie. It is the SK solution. Then non-zero values of K are called 
K-level repliea-symmetry breaking (iTRSB). 

It is elear that the eomplexity of the solution inereases rapidly with the inereasing number of 
different values of of the overlap suseeptibilities or their differenees Axi, that is, with number 
K. We give here an example of the lowest repliea-symmetry breaking free energy {K = 1) as 
the next step beyond the SK solution 


/i(g;Xi,mi) = -^(l-g-Xi)^ + ^"iiXi(2g + Xi) 




Vrj In / PAi {2 cosh [li{h + riy/q + Ai 0a)]} 


m\ 


( 16 ) 


It has three parameters, g, to be determined from stationarity of the free-energy fune- 

tional from Eq. ( [T^ . It represents a free energy with the first level of ergodicity breaking or 
repliea-symmetry breaking (IRSB). 

Generally, free energy fx stands for ergodieity breaking on K levels, K generations of replieas. 
When the replica symmetry is broken, it also means that ergodicity is broken and the thermo- 
dynamie limit of the original system depends on the behavior of the spins of the surrounding 
bath, being the replieated spins. The physieal interpretation of breaking repliea symmetry is 
ergodicity breaking. The hierarchieal replieations of the system variables is then an iterative 
way to restore ergodieity or thermodynamie homogeneity in a larger phase spaee. The order pa¬ 
rameters from the replieated spaee rrii, Axi then play the role of Eegendre eonjugate parameters 
controlling the energy exehange between the original system and its simulated thermal bath. 

Eree energy /^(g; Axi, ■ ■ ■, Axk, • • •, contains 2K-\-l variational parameters, g, Axi, 
mj for i = 1,2,... K that are determined from the stationarity of free energy with respeet to 
small fluetuations of these parameters. The replica construction introduced a new parameter K 
that is not a priori determined. It ean assume any integer value in the true equilibrium. The 
number of replica hierarchies is in this eonstruction determined from stability eonditions that 
restrict admissible solutions, stationarity points. A solution with K levels is loeally stable if it 
does not deeay into a solution with K-\-l hierarehies. A new order parameter in the next repliea 
generation Ax may emerge so that Axi > Ax > Axi+i for arbitrary 1. That is, the new order 
parameter may peel off from Axi and shifts the numeration of the order parameters for i > I In 
the existing if-level solution. To guarantee that this does not happen and that the averaged free 
energy depends on no more geometric parameters than mi,..., mx we have to fulfill a set of 
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K 


1 generalized stability eriteria that for our hierarehical solution read for I = 0,1, 

o 


Af = l 





i=0 



> 0 


.K 


(17) 


with mo = 0 and formally (f)_^ = 0. We introdueed the following short-hand notation 
t = tanh /3 + + and {t)i{r]; Xk, Xi+i) = {pi ■ ■ ■ (pit)x, ■ ■ ■) 

with {X (A/)) A, = T>Xi X (Xi) and pi = (Z™\)a; . The lowest K for whieh all stability 

eonditions, Eq. G3. are fulfilled is an allowed equilibrium state. It need not, however, be the 
true equilibrium state, sinee the stability eonditions test only the loeal stability and eannot de- 
eide whieh of several extremal points is the true ground state. The stability conditions, Eq. ( [TT] ), 
are necessary for the system to be thermodynamically homogeneous. They are, however, not 
sufficient to guarantee global thermodynamic homogeneity. Note that the stability conditions 
from Eq. ( fTT] ) guarantee only local homogeneity, since they hold for the optimal geometric pa¬ 
rameters mi determined by the stationarity equations. The global thermodynamic homogeneity, 
Eq. ( [T^ , would demand > 0 for arbitrary positive mx- This is generally valid if Axk = 0. 
Eree energy with K hierarchies of replicated spin variables, Eqs. ( [T5] ), was derived by the stan¬ 
dard procedure utilizing ergodicity in the extended, replicated phase space. Real replicas in the 
thermodynamic approach, that is without the replica trick, were introduced to include control 
over thermodynamic homogeneity of the equilibrium state. The necessity to continue analyt¬ 
ically the free energy to arbitrary positive replication index forced us to introduce a specific 
structure to matrix as exemplified in Eig. Since > 0 we can consider it as a distance 
between replicas a and b. The reduction rules, Eq. ( [T4| ) lead to an ultrametric distance in the 
space of replicas [ 131. An ultrametric space is characterized by the existence of only equilateral 
or isosceles triangles. That is, for three replica indices a, b, c either or 

least one of these equalities holds. Ultrametricity is generated by the hierarchical structure of 
successive replications used to derive free energy fxiq, {x}; {rn}). 

The construction of the order parameters in the replicated phase space suggests that overlap 
susceptibilities measure the interaction strength with which different copies (replicas) of 
spins thermodynamically influence each other. That is, thermal averaging of one spin copy 
(a) depends on the values of spins of another copy (b) if > 0. We cannot separate these 
replicas although only one spin replica represents the physical system under consideration. The 
non-replicated original phase variables together with temperature and the chemical potential are 
hence insufficient to describe entirely the equilibrium thermodynamic states. To get rid of the 
dependence of thermodynamic states on the boundary or initial conditions we have to average 
over all initial/boundary values and external variables that influence the thermodynamics of the 
investigated system. In the long-range, completely connected models the degeneracy of the 
solutions of the mean-field equations is reflected in the dependence on the initial spin configu¬ 
rations. We simulated this dependence by self-consistent interactions between the original and 
replicated spin variables, where both spin species are subject to the same thermal equilibration. 
To understand the role of the geometric parameters (replication indices) mi we look at the /th 
level of replication. It appears that when ergodicity and the linear response with respect to 
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inter-replica interaction is broken the solution in the replicated space has the replication indices 
ordered in a decreasing succession 1 > mi > ... mx > 0. It allows us to give a straightforward 
interpretation of the successive replications. Let us take partition sum Zi_i and perform the next 
replication of the spin variables from Zi^i. The averaged interaction strength of the original 
and the replicated spins is Axi and the averaged number of the original spins affected by the 
interaction with the replicated spins is miN. The spins from the subspace with I — 1 replica 
hierarchies are affected by thermal fluctuations of the spins from the next, /th hierarchy. The 
Gaussian spins from the Zth hierarchy are A; and their thermal fluctuations are represented by a 
Gaussian integral. The free-energy density of the systems with I replica hierarchies then is 

fi(hi) = In y VXi zr_\ (/3, , 

where hi is an internal magnetic field. 

These hierarchical replications of the mean-field models can be understood as hierarchical em¬ 
beddings of a finite volume V into larger volumes with the surrounding spins, see Fig. The 
density matrix of the spins from the /th shell is pi = Z^\/{Zl ^\)We can now perform the 
thermodynamic limit of the volume VJ_i —)■ oo with no surrounding spins or together with the 
next shell V; — )■ cxd. If the the system in the volume VJ-i is ergodic, the thermodynamic limit 
should not depend on the behavior of the surrounding spins. Here is the core of the problems 
and the instability of simple mean-field solutions of spin-glass models. They break ergodicity 
in the whole low-temperature phase and the replica-symmetry breaking is a mathematical rep¬ 
resentation of ergodicity breaking. The hierarchical construction is a way to incorporate the 
influence of the thermal bath on the original spin systems in the thermodynamic limit. 


2.4 Continuous limit: Parisi solution 


Free energy /i^(g; Axi ,..., Axk, mi,..., ttik) is an analytic function of its order parameters 
derived from K hierarchical embeddings. Due to the embedded structure of the partition sums 
Zi it is practically impossible to find explicit solutions for iT >2 in the whole temperature range 
of the glassy phase. Parisi found that in the case of the Ising spin glass solutions for K = 1,2 
are unstable and assumed that the same holds also for all finite iF’s. He then performed the 
limit K ^ oo and derived a continuous version of the infinitely-times replicated system by 
assuming Axi = Ax/K —)■ dx. Second and higher powers of Axi with the fixed index I are 
neglected When performing the limit —)■ cx) in representations of Eqs. ( [T5] ) the 


free-energy functional can then be represented as [37 38 j 


f{q,X;m{x)) = -^(1 - g - X)^ - ^ln2 


+ ^y dxm{x)[q + X-x]-^{g{X,h + rix/q))^ (18) 
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Fig. 2: The thermodynamic limit of a system of spins Sq confined in a volume Vq —)■ cxd can 
either be performed in a free space or embedded in a bath of external spins Si in a larger 
volume Vi —?• cx). The bath spins have a density matrix pi. If the two thermodynamic limits 
are different, we must embed the system into a next bath of spins with a density matrix p 2 - We 
continue with the embeddings so long until the smaller and the larger system lead to the same 
thermodynamic limit. 


where {X{r]))rj = This free energy is only implieit sinee its interacting part 

g{X, h) can be expressed only via an integral representation containing the solution itself 


g{X, h) = Eo(/i; X, 0) o gfih) 


= exp <; - 


cX 


dx [dl + m{x)g'{x] h -\- h)di\ > g{h -f h) 


(19a) 


h=0 


with gfh) = In [cosh/3/;,]. The ’’time-ordering” operator orders products of a:-dependent 
non-commuting operators from left to right in an x-decreasing succession. The exponent of the 
ordered exponential contains function g'{x] h) = dg{x] h)/dh for x G [0, X] and is not known 
when g{x; h) is not know on the whole definition interval. This derivative can also be expressed 
via an ordered exponential 


g\X,h) = nh-.X,D)og'^{h) 

rX 


= exp 


dx 


]^dl + m{x)g'{x]h + h)d-h 


g'fih + h) 


(19b) 


h=0 


It is an implicit but closed functional equation for the derivative g'{x] h) on interval [0, X] for 
a given function m{x). We have to know the full dependence of this function on parameter x 
to evaluate the free energy with continuous replica-symmetry breaking. It is important to note 
that free energy f{q,X;m{x)) defines a thermodynamic theory independently of the replica 
method within which it was derived. It means that we can look for equilibrium states of spin- 
glass models without the necessity to go through instabilities of the discrete hierarchical replica- 
symmetry breaking solutions. 
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Analogously we can perform the limit K ^ oo with mi — m;_i = —Am/K —)■ —dm in 
representation Eq. ( |15a| ). The minus sign is used, since we expect ordering mi < mi_i. Further 
on, we use Axi —x{m)dm. The limiting continuous free energy can then be represented 
as Ipl 


/ {q,Xi,mi,mo-,x{m)) 


= -^(1 -Q- XiV + ^ [mi {q + Xi? 

-jf dm[q + xi- X{m)f - ^ 
^ J mo m 


- moq^] 

{gi{mo,h + T]^))^ 


where we denoted X{m) = dm'x{m') and 


( 20 ) 


gi{mQ,h) = Eo(mo,mi,/i) o g^{h) 

Y /•mi 
2 


= exp 


dm x{m) \dj^ + mg[{m-, h + h)dj[\ > gi{h + h) 


'mo 


, (21a) 


h=0 


and 


gi{h) = gi{mi,h) = ! ^=e [2 cosh (/?(/i + 0^/)^))] 

' —oo V ■^’TT 


mi 


mi 


(21b) 


This free energy better suits the case when the solution with continuous RSB peels off from 
a solution with one-level RSB or the two solutions coexist. The space of order parameters is 
restricted to an interval 1 > mi > mo and I > Xi A X{m) > 0. 

If free energy fx is not locally stable and at least one of the stability conditions, Eq. ( fTT] ), is 
broken for all A"’s, it is still a question whether the continuous limit K ^ oo is locally stable. 
It can be shown that continuous free energy f(q,X;m{x)) is marginally stable and fulfills the 


continuous version of stability conditions with equality [ 371 


1 = {E{hn-, X, x) o [g'^{x, hr^f] 


( 22 ) 


This equation is a consequence of the stationarity equation for the order-parameter function 
m{x). We recall that the prime stands for the derivative with respect to the magnetic field and 
the second derivative of g^{x, h) obeys an integral equation 

d'^g^{x, h) 


dh^ 


= E(/i;a:,0) o^"(/i) + / dy x, y) o [g''^{y^ hf] . 


(23) 


The continuous free energy hence does not break ergodicity and is always marginally ergodic in 
the whole spin-glass phase. The ferromagnetic model is marginally ergodic only at the critical 
point, since the order parameter makes the ordered phase ergodic. 


Both continuous free energies, Eq. ( [18] ) and ( |20| ), were derived as the limit of the number of 
replica hierarchies K oo where the distance between the neighboring hierarchies is infinites¬ 
imal, that is Axi oc K~^, and Axi/Ami < oo for each I < K. Representation (|20|) is, however. 


more general, since it does not assume Xic —^ 0 in the limit K ^ oo as free energy, Eq. ( [18] ), 
does. On the other hand, condition xk 0 guarantees thermodynamic homogeneity of the 
resulting free energy. 
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Fig. 3: Entropy (left panel) and free energy (right panel) in the glassy phase of the Sherrington- 
Kirkpatrick model at zero magnetic field for the replica-symmetric and IRSB solutions. Im¬ 
provements at very low temperatures are evident, in particular, the unphysical negative value of 
entropy is significantly reduced. 


The eontinuous free energies were derived for the Ising spin glass but they can be straightfor¬ 
wardly generalized to other spin-glass models. The symmetry of the order parameters has to be 
adapted and the input single-site free energy g or gi is to be appropriately modified [|^|38|. 


3 Asymptotic solutions of mean-field models: K-level replica 
symmetry breaking 

3.1 Ising glass 


The Sherrington-Kirkpatrick model is the paradigm for the mean-field theory of spin glasses. It 
is this model for which Parisi derived a free energy with continuous replica-symmetry break¬ 
ing [23-25|. It was also later proved that the hierarchical scheme of replica-symmetry break¬ 
ing covers the exact equilibrium state [|^[^. The rigorous proof does not, however, tell us 
whether the equilibrium state is described only by a finite number of replica hierarchies or a 
continuous limit is needed. Only a few years ago we resolved the hierarchical free energy 
/x((?; • • •, • • •, ^k) for arbitrary K via the asymptotic expansion below the 

transition temperature in a small parameter 9 = 1 — T/T^ [47|. Only this asymptotic solution 
was able to resolve the question of the structure of the equilibrium state, at least close to the 
transition temperature. 
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3.1.1 Zero magnetic field 


The order parameters in the spin-glass phase of the general iT-level free energy from Eqs. ( [T5] ) 
eannot be solved explieitly in the whole temperature range unless we resort to solutions with 
only a few hierarehieal levels {K = 1,2). The repliea symmetric and IRSB solutions in the 
whole low-temperature phase are plotted in Fig. where one ean see the improvements of the 
repliea-symmetry breaking seheme in free energy and entropy. One has to go to higher repliea 
hierarchies. The only ehance to analyze the behavior of the entire hierarehieal eonstruction 
with an arbitrary number of hierarehies is to expand the solution near the critieal point where 
the order parameters are small. 

The strategy to solve the stationarity equations for the hierarehieal free energy asymptotieally 
near the eritieal temperature is to expand the partition funetion into powers of the small or¬ 
der parameters and to restriet the solution only to a funetional subspace generated by a fixed 
polynomial expansion. We first use sueh an expansion to derive the leading asymptotie limit of 
equations for the physical parameters g, Axi- At this stage we do not need to assume smallness 
of the geometrie parameters. Smallness of I = 1,..., K at zero magnetic field is utilized 
later on when deriving the asymptotie form of mean-field equations for them. 

After a rather lengthy and tedious ealeulations one finds the leading order of the order parame¬ 


ters [471 


^xf = 


2K + 1 






2K + 1 
^ 9. 


2K + 1 


(24a) 

(24b) 

(24c) 


The result proves that the limit K ^ oo leads indeed to the Parisi continuous replica-symmetry 
breaking, sinee all the order parameters are of order K~^. Eaeh solution with a finite number of 
repliea generations is unstable 


= -- _ - _ 

^ 3 (2A: + 1)2 


< 0 , 


(24d) 


from whieh it follows that the Parisi solution is the true equilibrium state in the glassy phase of 
the Sherrington-Kirkpatriek model near the transition point. 

Other physieal quantities in the asymptotic limit are the Edwards-Anderson parameter defined 


as = g + Yld=i with its asymptoties 


= 9 + 


12K{K + 1) + 1 
3(2iT + 1)2 


9 ^ 


(25a) 


the local spin susceptibility 


K 


» =I 1 -'2'' + E ^ 1 - 3(2if + IP 


9 ^ 


(25b) 
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and the free-energy differenee to the paramagnetie state 


^/ = 






(25c) 


Differences between different levels of RSB manifest themselves in free energy first in fifth 
order to which one had to expand the free energy in the order parameters. 


3.1.2 Non-zero magnetic field 


The glassy phase in the Sherrington-Kirkpatrick model exists also in an arbitrary strong applied 
magnetic field. The transition boundary separating the paramagnetic from the glassy phase is 
the de Almeida-Thouless line. It is defined by vanishing of the stability function /I = 0 of 
Eq. Q. The hierarchical solution behaves in an external magnetic field differently from the 
rotationally invariant case. The physical order parameter q and the geometric order parameters 
mi remain finite at the transition to the paramagnetic phase and only the differences of the 
overlap susceptibilities Axi are the genuine small parameters controlling the expansion around 
the critical point. A small expansion parameter below the AT line can be chosen as 


a 


= - 1 > 0 , 


(26) 


where we denoted to = tanh /3 [h + and go = {to)rj- 

One must first expand the SK parameter g to the two lowest nontrivial orders in a. The solution 
is then used to determine the lowest asymptotic order of xi and mi. We obtain mi = mi + 0{a) 


and xi = Ya=i with 


mi = 


((i-w. 


and 


Xi = 


a 


0 ( 0 ^) 


(27) 


(28) 


2 (]^mi 1 - 3/32 (t2(l _ ^2)2^^ 

These two parameters do not depend on the number of hierarchical levels used. Parameter mi is 
of order unity even at the boundary of the spin-glass phase (AT line) where the small parameter 
a vanishes. 

To disclose the leading asymptotic behavior of each separate parameter Axi and mi for I = 
1,..., K we must go beyond the leading orders in parameters m and Xi- It is first the fourth 
order in a from which we find that Axi = Xi/ K and 


mf = mi + 


K + 1-21 

“a 


Am 


(29) 


where we added a superscript to specify the number of hierarchical levels used to determine the 
order parameters Xu^i- Further on, we introduced a parameter independent of the number of 
hierarchies Am = m\ — m^. This parameter has an explicit asymptotic representation 


Am = 


l3^Xi ((1 - ^ 0 )^ (2 (1 - 3fo)^ + 3 (fg - 1) m {8tl + {tl - 1) m) 




(30) 
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Both parameters xi Am are linearly proportional to a. The former, however, exists already 
in IRSB, while the latter first emerges in 2RSB. Sinee they do not depend on the number 
of hierarehies used and the latter determines a uniform distribution of parameters mi for I = 
3,K, we demonstrated that all eharaeteristie features of the asymptotie solution near the 
AT instability line are eontained already in 2RSB. What was, however, highly nontrivial was to 
unveil equidistant distributions of both parameters xi and mi. 

The stability eonditions 

_ 2/3^ xi^rn 

^ 3iT2 m + 2 ^ ^ 

indieate that also in an applied magnetie field the equilibrium state is deseribed by the eontinu- 
ous repliea-symmetry breaking K ^ oo. 


3.2 Potts glass 

The Potts model with p states reduees to the Ising model for p = 2, but differs from it for 
p > 2 in that it breaks the spin-refleetion symmetry. This property was used to argue that the 
Parisi seheme fails to deseribe the equilibrium state [ [49| . It had been long believed that it is the 
one-level replica-symmetry breaking that determines the equilibrium state below the transition 


temperature [50|. The Potts glass displays a discontinuous transition to the repliea-symmetry 


broken state for p > 4 [511. Diseontinuous transitions do not allow us to use an asymptotie 
expansion in a small parameter below the transition temperature. It is, nevertheless, possible to 


test the ordered phase of the Potts glass for 2 < p < 4. We did it in Refs. [46 521 and found an 
unexpeeted behavior. 

Studying the diserete repliea-symmetry breaking we found two IRSB solutions with the same 
geometrie parameter 


p — 2 36 — 12p + „ 

m = -1-;-r —0 

2 8(4-p) 

One non-trivial IRSB solution then leads to order parameters 

= 0 , 

2 


Ax^^'^ = 


-e + 


228 — 96p -f p^ 


4 —p" ' 6(4 —p)3 

while the seeond one has both parameters nonzero 

-12 + 24p-7p2 






3(4-p)2(p-2)"^ ’ 
2 „ 360 - 204p 


-9 


Qp^ + 13p3^2 


4—p’ 6(4 —p)3(p —2) 

Both the solutions have the same asymptotic free energy to the fifth asymptotic order 


(32) 

(33a) 

(33b) 

(34a) 

(34b) 


/S 


p — 1 


flRSB — 


9^ 


+ 


(p(llp - 102) + 204)9^ 


3(4-p) 12(4-p)3 

(p(p((18744 - 1103p)p - 120648) + 325728) - 317232)03 


(35) 


720(4 - p)5 
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We ean see that the asymptotie expansion with small parameters q and Ax breaks down already 
at p = 4 above which we expect a discontinuous transition from the paramagnetic to a IRSB 
state at Tq > Tc = 1. Note that a transition to the replica-symmetric solution q > 0, Ax = 0 is 
continuous up to p = 6. 

The IRSB solution has a higher free energy than the replica-symmetric one. The difference is 
of order 0^, 


fiRSB — fns 


(p — 2)^(p — 1)0^ 

3(4-p)(6-p)2 ■ 


(36) 


The two stationary states of the IRSB free energy behave differently as a function of parameter 
p. The former solution is physical for all values of p unlike the latter that becomes unphysical 
for p > p* 2.82 where q^'^^ from Eq. P4a[ ) turns negative. It is also the region of the parameter 
p where the first solution is locally stable as can be seen from the stability function 




(37) 


That is why the solution with q = 0 was assumed to be the true equilibrium and a solution with 
a continuous replica-symmetry breaking had not been expected to exist. We, however, found 
that there is a Parisi-like solution even in the region of stability of the solution from Eq. ( [33] ). 
The second IRSB solution is unstable and decays to solutions with higher numbers of replica 
hierarchies as 




1 12 


24p + 7p2 ^2 




3iT2 (4 _p)2(p_2) 
1 2 


K {A-p) 


9 


.K 


m, = 


. p — 2 


+ 


p 


3 + -p - p2 + 


6p + ^p2 


2 / - 1 
2K 


0 . 


(38a) 

(38b) 

(38c) 


We can see that the ifRSB solution behaves unphysically in the same way as the second IRSB 
solution does. The averaged square of the local magnetization is negative for p > p* where 
the first IRSB solution is locally stable. Negativity of q means that local magnetizations are 
imaginary and the solution is unphysical. This deficiency, however, decreases with the increas¬ 
ing number of spin hierarchies and disappears in the limit —)■ cx). It means that the resulting 
solution with a continuous replica-symmetry breaking shows no unphysical behavior. It is anal¬ 
ogous to negativity of entropy in the low-temperature solutions of iFRSB approximations of the 
Sherrington-Kirkpatrick model. 

Potts glass hence shows a degeneracy for p* < p < 4 with a marginally stable solution continu¬ 
ously breaking the replica symmetry and a locally stable one-level replica-symmetry breaking. 
To decide which one is the true equilibrium state one has to compare free energies. The differ¬ 
ence of the continuous free energy fc and that of the iFRSB solution is 


f^ifc — IrRSb) 


(p-l)(p(7p-24)+ 12)205 


720774(4-p) 5 


(39a) 
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Fig. 4: Left panel: Entropy S (left scale, dashed line) and local stability A (right scale, solid 
line) of the IRSB solution from Eq. ( [3^ of the 3-state Potts glass. The solution becomes locally 
unstable at 0.33Tc and entropy negative at T ^ 0.16Tc. Right panel: The free energy 
differences between the solution with continuous replica-symmetry breaking and IRSB (left 
scale, solid line) and RS (right scale, dashed line) solutions. 


and that of the replica-symmetric one reads 


Pifc - Irs) 


(p — l){p — 2)‘^9^ 
3(4-p)(6-p)2 ■ 


(39b) 


We see that the solution with the continuous RSB has the highest free energy as the true equilib¬ 
rium state should have for geometric factors m < 1. In this situation entropy reaches minimum 
and free energy maximum in the phase space of the order parameters. The locally stable IRSB 
solution becomes unstable at lower temperatures and entropy turns negative at very low temper¬ 
atures as demonstrated on the 3-state model in Fig. This leads us to the conclusion that the 
Parisi solution with a continuous replica-symmetry breaking represents the equilibrium state for 
the Potts glass with p < 4. 


3.3 p-spin glass 


The spin model generalized to random interactions connecting p spins, the p-spin glass, was 
used to simulate the dynamical transition in real glasses [ |53]|54| . This model, analogously to the 
Potts glass, generalizes the Ising spin glass to p > 2 and allows one to study the behavior of the 
equilibrium state as a function of parameter p. In particular, the limit p —)■ cx) is accessible [ 101 
and is exactly solvable. It coincides with the random energy model of Derrida pTj[T^ . For this 
reason the p-spin glass was also intended to be used to study and understand the genesis of the 
Parisi free energy when studying the asymptotic limit p —)■ cx). 


To cover both the boundary solutions p = 2 and p = cx we have to mix up the one-level RSB 
scheme and the Parisi continuous RSB. Such free energy density of the mean-field p-spin glass 
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reads[39| 


=-^ 1-p(g + Xi) + (P-1) + 


+ 


P 


1 


Pi {q + xi) 


p/(p-l) 


Pog' 


p/(p-i) 


p 


r-pi 


dp [q + Xi- ^(p)] 


p/(p-i) 


' Po 


-Pi(Po,/i), (40) 


with 


Pi(po,(i) = IEi(pi,po,(i) o [Pi((i)] = T^exp <j/ dpx{p) 




MO 


+ ppl(p>(i ++ 


(41a) 


/i=0 


where X(/r) = dp'x{p'). The generating free energy is 


9 i{.h) = - In 
Pi . 


dcf) 


02/2 


—oo \/ 2 ?! 


2 cosh f/3(P -f 0\/pxi/2) 


Mi//3 


(41b) 


We resealed variable m —)■ /i = (dm. If /i = 0 or /ii = /io, free energy reduees to the IRSB 

approximation. On the other hand, if /xq = 0, or /xq = /? free energy coincides with that of 

the Parisi solution with a continuous replica-symmetry breaking. 

The p-spin glass can be used to investigate analytically not only the p ^ oo limit but also the 
T —)■ 0 limit. In this limit simple solutions of mean-field models lead to negative entropy. It is 
easy to calculate the zero-temperature entropy in the IRSB solution. We obtain 

'exp{-plpxi/4:} exp{-PVPXi}’'^ 


So{h) oc 


P(P- 1) 
8 


V^PXi 


2CH^{h) 


where we used the following notation 

2CH^{h) = -f , 

E^P\h) = n # ^-(0-pi^pxi/2)"/2 

J ^/\/pXl/2 


(42) 

(43a) 

(43b) 


The negativity of the low-temperature entropy indicates that IRSB cannot produce a stable 
ground state for arbitrary p < oo. The negativity of entropy decreases with increasing p, see 
Fig. but only if a condition p\pxi = cxd is fulfilled the IRSB solution (/xi > 0) leads to 
zero entropy at zero temperature. Nonnegative entropy is a necessary condition for physical 
consistency of the low-temperature solution. It then means that the low-temperature equilibrium 
state for p < oo must contain the Parisi continuous order-parameter function x{p) with (d > 
Pi > Pq. It can also be seen from the asymptotic free energy for p —)■ oo that reads 

fT^°°\q,Xi,Pi) = - ^ [1 - (9 + Xi) (1 - ln(g + Xi)] - — hi[2cosh(/xiP)] 

4J Pi 


^ [Xi - (9 + Xi)ln(g-fxi)] - ^ [lng + p(l-tanh^(/xiP))] , (44) 


piq 
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Fig. 5: Entropy of the IRSB solution of the p-spin glass. Temperature dependence for different 
values of p (left panel). Logarithm of the negative part of entropy at zero temperature as a 
function of 1/p (right panel), from Ref. (39]. 


giving the leading-order solution for the variational parameters Xi^ q. The first two 

parameters are of order one while the latter is exponentially small for large p. 


Xi = 1 - g, 

q = exp{—p(l — tanh^(/ii/i)} , 

Pi = 2-^111 [ 2 cosh(/ii/;,)] — hta.nh.(pih) . 


(45a) 

(45b) 

(45e) 


The above nontrivial solution holds only if (3 > 2^ln [2 cosh(/3/;,)] — htanh.{l3h) (low-temp¬ 
erature phase), otherwise pi = jS and Xi + 9 = ^ (high-temperature phase). To derive an 
equation for the order-parameter funetion x(p) one needs to inelude the next-to-leading order 
eontributions. To go beyond the leading asymptotie order one ean use the Landau-type theory 
for the order-parameter funetion developed in Ref. p8| . Note that the asymptotie solution of 
Eqs. 


with x(p) =0 suffers from a negative entropy as ean be seen from Eq. ( |42| ) and is 
plotted in Eig.|^ Note that the transition to the ordered phase in the p-spin glass is diseontinuous 
and henee, an asymptotie expansion below the transition temperature is not applieable. Only an 
asymptotie expansion p —)■ oo makes sense. 


4 Conclusions 

The mean-field models of spin glasses have equilibrium states demanding nonstandard tools to 
deseribe them quantitatively. Moreover, the repliea triek standardly used is suspieious and it is 














Mean-Field Spin-Glass Models 


5.25 


diffieult to understand and give a physieal meaning to the order parameters and the funetions 
with the replica variables in this construction. The standard way to reach the equilibrium states 
is to use the replica trick, derive representations with the replica variables and then try to give 
the results a physical meaning. The reason for using the replicas remains nevertheless veiled in 
this way and the physical meaning of the replica-symmetry breaking unclear [45 |T3|. One has 
to analyze the physical reasons for instabilities and negative entropy in non-replicated mean- 
field solutions to find the genuine reason why the true equilibrium of the mean-field spin-glass 
models cannot be reached without replicas. 


The most prominent feature of the mean-field spin-glass models is that the combination of 
randomness and frustration of the spin exchange leads to ergodicity breaking that is not ac¬ 
companied by any symmetry breaking in the generic Hamiltonian. To restore ergodicity in the 
glassy phase one can use replications of the phase space of the dynamical variables. A small 
inter-replica interaction is introduced as a perturbation and the linear response of the system is 
calculated. If the linear response (replica independence or symmetry) is broken, replica vari¬ 
ables influence the behavior of the original system, and inter-replica interactions become non¬ 
zero. The replication is then used hierarchically till one restores at least local thermodynamic 
homogeneity. The principal step in this procedure is to select an adequate symmetry-breaking 
of the replicated variables so that to make thermodynamic potentials analytic functions of the 
originally integer replication index. Only then it is possible to test and restore thermodynamic 
homogeneity and ergodicity. If infinitely-many replications are needed the Parisi solution with 
the continuous replica-symmetry breaking is obtained. Real replicas allow us to restore ergod¬ 
icity in hierarchical steps by breaking successively independence of the replicated spaces. 

The solution of the full mean-field models of spin glasses in unreachable. One has to resort 
to approximations or perturbative expansions. We applied the real replicas on the mean-field 
Ising, p-state Potts and p-spin glass models and calculated their asymptotic solutions below the 
transition temperature to the glassy phase. We thereby demonstrated that the Ising spin glass 
below the transition point is described by a solution with infinitely-many replica hierarchies 
with the continuous order-parameter function of Parisi. While the Ising spin glass is known to 
have continuously broken replica symmetry in the equilibrium state, the Potts and p-spin glasses 
allow for locally stable solutions with a one-level discrete replica-symmetry breaking. Since the 
solution with the continuous replica-symmetry breaking exists independently of stability of the 
solutions with finite-many replica hierarchies, the continuous RSB and IRSB coexist in the 
p-state Potts and the p-spin glass models. In both cases for p < oo the IRSB state leads to 
negative entropy at very low temperatures and the ultimate equilibrium state for the mean-field 
spin-glass models breaks the replica symmetry in a continues form as suggested by Parisi in 
the Ising model. Our analysis indicates that a continuous RSB is indispensable to keep entropy 
non-negative down to zero temperature. Spin reflection symmetry is hence not substantial for 
the existence of a solution with a continuous replica-symmetry breaking as was previously 
assumed. 
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